THE KADISON-SINGER PROBLEM IN DISCREPANCY 

THEORY, II 
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Abstract. We apply Srivastava's spectral sparsification technique to a vector 
balancing version of the Kadison-Singer problem. The result is a one-sided 
version of the conjectured solution. 



The celebrated Kadison-Singer problem (KSP) is equivalent to a simple vector 
balancing question ([5], Theorem 3). Do there exist constants JV,reN which make 
the following statement true? 

If k £ N and {v\, . . . ,v m } is a finite sequence of vectors in C fc 
satisfying ||u,|| = -^L for all i and 



\{u, Vl )\ 2 = l 



for all unit vectors u, then the index set {1, . . . , m} can be parti- 
tioned into subsets Si , . . . , S r such that 

for all unit vectors u and all j = 1, . . . , r. 

Here ||w|| is the euclidean norm of v. It is unclear whether allowing r > 2 makes 
the problem any easier. If we take r = 2 then we can equivalently ask whether it is 
always possible to find a subset S C {1, . . . , m} satisfying -^L < J2ies K u > Vi )\ 2 — 
1 — -7= for all unit vectors u. The purpose of this note is to present a partial 
positive result in this direction: for any n < m we can find a subset S C {1, . . . , m} 
with \S\ — n and such that 

V|(^)| 2 <- + o(^ 

its m 

for all unit vectors u. This is a "one-sided" version of the desired result in the sense 
that we achieve an upper bound but not a lower bound. 

Our theorem is a straightforward application of the spectral sparsification tech- 
nique introduced in Srivastava's thesis [5]. This technique was already related to 
KSP via Bourgain and Tzafriri's restricted invertibility theorem [7J[5]. That result 
can be converted into one resembling ours as in the proof of Theorem 4.2 of [4], but 
with a substantially worse bound (on the order of — + 2«/^). 
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1. The projection version of KSP 

The Kadison-Singer problem was first posed in [5] in the form of a C*-algebraic 
question relating pure states on B(l 2 ) to pure states on its diagonal subalgebra. 
Since then it has been found to have numerous equivalent versions, and it is now 
considered a major open problem with relevance to topics ranging from Banach 
space theory to signal processing. We refer to [4] for general background and a 
survey of a variety of equivalent versions of the problem. 

Our version is based on the approach of Akemann and Anderson [I] in terms of 
projection matrices. A complex to x to matrix is a projection if the associated linear 
map orthogonally projects vectors in C m onto some linear subspace E. Note that a 
diagonal matrix is a projection if and only if its diagonal entries are all either zero 
or one. The Akemann- Anderson version of KSP asks whether there exist constants 
e, S > and r £ N which make the following statement true. 

If to e N and P is a complex mxm projection matrix whose 
diagonal entries pa satisfy pa < 5, then there are diagonal pro- 
jections Qi, . . . , Q r which sum to the identity matrix and satisfy 
WQjPQiW < 1-e for allj = l,...,r. 

That a positive answer to this question implies a positive solution to KSP is essen- 
tially proven in Propositions 7.6 and 7.7 of pQ, and the reverse direction is shown 
in Theorem 1 of [9 . A more elementary approach to this reduction appears in [3] . 

The projection version of KSP is easily seen to be equivalent to a vector balancing 
question similar to the one stated in the introduction. Identify the range E of P 
with C k where k is the rank of P and dehne u,; = Pei, 1 < i < to, where {e^} is 
the standard basis of C m . Then for any vector u € C m we have 

in particular, if u is a unit vector in E then this sum equals 1. Also, ||vi|| 2 — 
(Pei,ei) = pa < <5, giving us a bound on the size of the vectors Vi. The diagonal 
projections Qj correspond to a partition of S into r pieces. 

The version of KSP stated in the introduction, in which the vectors Vi all have 
the same norm -^=, can be achieved by adding extra dimensions to the space and 
augmenting the vectors Vi with components in these extra dimensions. See Theorem 
3 of [S] for details. In the language of projections, this corresponds to requiring 
that the diagonal entries of P all equal and asking for HQjPQjH < 1 — ^7=. 

2. Counterexamples 

Let k,N € N and suppose {vx, . . . ,v m } is a finite sequence of vectors in C k 
satisfying \\vi\\ = — j= for 1 < i < m and 

£K«,«i)l 2 = i 

i 

for all unit vectors u. According to Proposition 4 of [5] we can find a subset 
S C {1, . . . , to} such that 

- - — < ^ Ke,*,Ui)| 2 < - + — 
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for all 1 < j < k, where {ej} is the standard basis of C k . This follows by applying 
the continuous Beck-Fiala theorem [2] to the vectors (|(ei, Vi) | 2 , . . . , | (e^, U,) | 2 ) £ R fc 
for 1 < i < m. Thus, on a fixed orthonormal basis a very tight bound can be 
achieved. However, this bound is too strong in general. We know from Example 7 
of [5] that there are configurations of vectors with N, k — > oo such that for any S 
there is some unit vector u for which the sum ^2 ieS | (u, Uj) | 2 lies outside an interval 
which is asymptotic to (| — jyjj^> 5 + TTTn^' Thus, the wors t counterexamples 
we know of are O(-^L) away from |. The obvious conjecture is that we can always 
find a set of indices S for which 

5-°(^ £ 5 l( *'"'>' 2 ^ +0 (^) 

for all unit vectors u. Or perhaps even for any q £ (0, 1) we can always find an S 
for which 




for all unit vectors u. 

What we are trying to accomplish is to build up a set of indices S which makes 
Sies \ ( u i v i)\ 2 uniformly greater than in all directions u, while preventing this 
sum from getting too close to 1 in any direction. An example due to Nets Katz [6] 
shows why this may be difficult. Fix N £ N and let X be the family of all subsets 
of {1, ... , 27V} of size N. For each 1 < i < 2N let f z : X -> R be the function 
satisfying fi{A) = if i £ A and f t (A) = if % € A. Then f t (A) = \A\ ■ i = 1 
for each A £ X, so the functions fi have sup norm and sum up to 1 at every 
point. Now for any SC{1,..,, 2iV}, if \S\ < N then we can find A £ X disjoint 
from S, so that J2ies /*(^) = ^- ^ 1^1 — ^ then it contains some A £ X, and 
we then have X^es /i(^) = 1- So we cannot get away from at all points of X 
without summing to 1 at some point. 

However, the result we prove in the next section shows that nothing like this 
can happen with KSP. In Katz's example any set of at least half of the functions fi 
must sum to 1 at some point. Whereas our theorem achieves an upper bound only 
O(^) higher than^. 

3. An upper bound 

As in the introduction, {v±, . . . , v m } will be a finite set of vectors in C k , each of 
norm -^j=, satisfying 

X>>«<>| 2 = 1 

i 

for all unit vectors u. We work with the linear operators v <g> v : C k —> C k defined 
by (v ® v)(u) — (u, v)v. For any S C {1, . . . , m} the operator T — ^2 ieS Vi ® Vi 
satisfies 

(Tu,u) = ^2 l( M ' u *)| 2 > 

and the values (Tu,u), for u a unit vector in C k , are all bounded above by ||T||. 
Thus we are interested in choosing S so as to minimize ||T|). Note that Tr(vi<£)Vi) = 
\\vi\\ 2 = jr and Y^iLi v i®Vi— /, which has trace k, so that m = kN. 
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Let n < m. As in [8], we build the subset S one vector at a time. Thus 
our procedure will select vectors , . . . , Vi n with corresponding operators Tj = 
Sd=i v id ® w id- For an y positive operator T and any a > ||T||, define the upper 
potential $ Q (T) to be 

$ a (T) = Tr^al-I 1 )" 1 ); 

then having chosen the vectors , . . . , Vi j _ 1 we will select a new vector t>j. so as to 
minimize ^> aj (Tj), where the a,j are an increasing sequence of upper bounds. This 
potential function disproportionately penalizes eigenvalues which are close to aj 
and thereby controls the maximum eigenvalue, i.e., the norm, of Tj. The key fact 
about the upper potential is given in the following result. 

Lemma 3.1. f]5], Lemma 3-4) Let T be a positive operator on C k , let a,5 > 0, 
and let v € C k . Suppose ||T|| < a. If 



(((a + 6)1 -T)- 2 v,v) 



+ {{{a + 5)1 -T)~\,v) < 1 



<I> a (T) — $ a + s (T) 
then \\T + v®v\\ <a + 5 and $ a + s (T + v ® v) < $ a (T). 

The proof relies on the Sherman-Morrison formula, which states that if T is 



positive and invertible then (T + v <S> v) 1 = T 1 — — — ^"® V ^ T — 



We also require a simple inequality. 

Lemma 3.2. Let a± < ■ ■ ■ < a* and b\ > ■ ■ ■ > bk be sequences of positive real 
numbers, respectively increasing and decreasing. Then ^aibi < j^^ai^bi. 

Proof. Let M = i J] bi. We want to show that a i°i ^ S a iM, i.e., that ^2 a>i(bi — 
M) < 0. Since the sequence (bi) is decreasing, we can find j such that bi > M 
for i < j and h < M for i > j. Then £Li a dh ~ M ) < a j ELi( 6 * ~ M ) ( since 
the at are increasing and the values bi — M are positive) and J2i=j+i a i(bi — M) < 
a j Yli=j+i fti ~ M) (since the at are increasing and the values bi — M are negative). 
So 



fc k 



ai (bi - M) < a 3 }^(b, - M) = 0, 

i=l i=l 

as desired. □ 



Theorem 3.3. Let fc, N G N and let {v\, . . . , v m } be a finite sequence of vectors 
in C k satisfying ||uj|| = for 1 < i < m and 

£imi 2 = i 

i 

for all unit vectors u. Then for any n < m there is a set S C {1, . . . , m} with 
\S\ = n such that 

for all unit vectors u. 
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Proof. Define <2j = ^7= + ^1 + ^ - j ^ for < i < re. We will find a sequence of 

distinct indices i±,...,i n such that the operators Tj = X^d=i w id ® u »d j — 3 — n i 
satisfy ||T,j|| < a 3 and $ Q °(T ) > • • > $ a "(T„). Thus 

11 || 1 / 1 \ n n ( 1 

T„ < — + ( 1 + — — = - + o[-= 

•JN V VN-lJm m \Jn 



yielding the desired conclusion. We start with To = 0, so that $ a °(To) = 

To carry out the induction step, suppose , . . . , Vi j have been chosen. Let 
Ai < • • • < Aft be the eigenvalues of Tj. Then the eigenvalues of I — Tj are 1 — Ai > 

■ • • > 1 — At and the eigenvalues of (a^+il — T,) -1 are < . . . < 3__, 

Thus by Lemma [JO] 

fc 1 

Tr((a j+1 I-Tj)-\l-Tj)) = £ -(1 - A d ) 



< 

= ^((a^-T,)- 1 )^/-^) 

= ~<& a ' +1 (Tj)Tr(J — Tj) 

< ^(T^J-Tj-) 

< (T )Tr(I - Tj) 
= VNTr(I-Tj). 



Next, au+i — a, = fl H — r=i — ) — , so we can estimate 

1 J ^ ^/TV — I'm' 

$«i _ = Tr(( aj J - I})" 1 - (o J+1 J - Tj)' 1 ) 



= (l + i-MtoJ - T i} V,^ - T,)" 1 ) 

since each of the eigenvalues a ^ Xd a . + l_\ d °f t ne operator (a^-J — Tj) _1 (aj +1 7 — 
Tj)^ 1 is greater than the corresponding eigenvalue ( a "j^zrr^p °f the operator 
(Oj+i/ — Tj)~ 2 . Combining this with Lemma 13.21 yields 

Tr((a j+1 I-Tj)- 2 (I-Tj)) < ±Tr((a j+1 I - Tj)- 2 )Tr(I - Tj) 

< N\l- — ($ aj (Tj) - <J>^ +1 (Tj))Ti(I - Tj) 

since ( 1 + 7w-ir 1 = 1 -vw- Thus 

Tr((aj +1 I-Tj)- 2 (I-Tj)) ^ / 1 



Now let 5' C {1, . . . , m} be the set of indices which have not yet been used. 
Observe that (Tv, v) = Tr(T(v ® w)) and that J2ieS' Vi®Vi = I — J2d=i v id ® v id = 
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I-Tj. Thus 



<N\1- -j=j Tr(I - Tj) + VNTr(I - T s ) 
= NTr(I - Tj) 




But 



NTt(I - Tj) = N(k - Tr(Tj)) =m-j 



is exactly the number of elements of S'. So there must exist some ieS' for which 



In terms of projections, Theorem l3.3l states that if k, N G N and P is a projection 
acting on C k whose diagonal entries pa all equal -h, then for each n < kN there is 
a diagonal projection Q with Tr(Q) = ^ and such that ||QPQ|| < + O(-i-). 



In order to produce a positive solution to the Kadison-Singer problem we 
would have to improve Theorem 13.31 to simultaneously include a lower bound on 
J2 ies \{u, v,)] 2 . Now Tr(T n ) = f and T n < a n I where o» = £ + O(^), and thus 

Tr(a„7) = 7^ + ^(r^)- ^° mos t of the eigenvalues of T n must be around ^. The 
problem is that there could be a small fraction of eigenvalues at or near zero. 

If we only want a lower bound, the simplest way to achieve this is to apply 
Theorem 13.31 and take the operator I — T n . If T n = J2ies Vi ® Vi ^ nen I ~T n = 
Sies<= v i® v ii so I ~ T n is obtained by summing over m — n vectors. And the 
upper bound T n < a n I translates to the lower bound I — T n > (1 — a n )I = 
( m ^ ra — 0(^^))I. Here the danger is that there could be a small fraction of 
eigenvalues of I — T n at or near one. 

If one tries to run the argument of Theorem 13.31 in a way that simultaneously 
achieves both upper and lower bounds, one discovers that the two cases are not 
really symmetric. At each step the upper bound recedes, and we need to choose 
a new vector Vi j+1 in a way that avoids overtaking the upper bound. By making 
the upper bound recede faster, i.e., by increasing the step size from cij to a^+i, we 
can ensure that any desired fraction of the remaining vectors will accomplish this. 
The lower bound, on the other hand, is chasing the lower eigenvalues of Tj and in 
order to avoid increasing the lower potential we may have to choose a vector which 
is concentrated on a possibly small number of low eigenvalues. Slowing down the 
lower step size would only delay this. 

In order to handle both upper and lower bounds simultaneously, we have to avoid 
falling into a situation where the lower bound is approaching a handful of small 
eigenvalues, and the only vectors available which have components among these 
small eigenvalues also have components among the largest eigenvalues, and thus 



((a j+1 I-Tj) 2 v il v l ) 
$"j(Tj) - $°i+i(T.,-) 

Therefore, by Lemma |3. 11 choosing V4. 
proceed. 



+ ((dj+il -Tj) 1 v i ,v i ) < 1. 



= Vi allows the inductive construction to 

□ 



4. A LOWER BOUND 
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cannot be selected without overtaking the upper bound. It does not seem possible 
that any greedy algorithm of the kind used in the proof of Theorem 13.31 could be 
sure to prevent such a situation from developing. 
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